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PORTRAYAL OF HUMAN INFORMATION VISUALIZATION 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This is a continuation of International Application PCT/US98/18434, with an international 
5 filing date of September 4, 1998. This application also claims the benefit of the filing of U.S. 
Provisional Patent Application Serial No. 60/057,973, entitled Method for Displaying How 
Humans Visually Process Information, filed on September 5, 1997, and the specificafion thereof 
is incorporated herein by reference. 



10 BACKGROUND OF THE INVENTION 

Field of the Invention (Technical Field) : 

The present invention relates to display of information concerning human information 
visualization, particularly of two-dimensional objects such as advertisements. 



15 Background Art : 

In developing effective means to communicate with people using visual presentations, 
means for determining effectiveness of such presentations are required. In order to create 
effective advertisements, for example, one must have an effective means of judging the effects 
of the advertisement on the consumer. Preferably, such means must be easily and intuitively 

20 understood by decision makers at all levels. 

Prior mechanisms for assessing information concerning consumer processing of visual 
information, of varying complexity, include U.S. Patent No. 5,676,138, to Zawilinski, entitled 
"Emotional Response Analyzer System with Multimedia Display"; U.S. Patent No. 5,465,729, to 
25 Bittman et al., entitled "Method and Apparatus for Biofeedback"; U.S. Patent No. 5,331 ,969, to 
Silberstein, entitled "Equipment for Testing or Measuring Brain Activity"; U.S. Patent No. 
5,227,874, to Von Kohorn, entitled "Method for Measuring the Effectiveness of Stimuli On 
Decisions of Shoppers"; U.S. Patent No. 5,052,401, to Shenwin, entitled "Product Detector for a 
Steady Visual Evoked Potential Stimulator and Product Detector"; U.S. Patent No. 4,861,154, to 
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Sherwin et al., entitled "Automated Visual Assessment System With Steady State Visual Evoked 
Potential Stimulator and Product Detector"; and U.S. Patent No. 4.647,964, to Weinbiatt. 
entitled "Technique for Testing Television Commercials". 

None of the above patents discloses the technique of the present invention in displaying 
information about reaction to an image by breaking the image into matrix cells and varying 
transparency of cells depending on information gathered about that ceil. None of the prior 
disclosures are believed to have the intuitive impact of the present invention, and therefore are 
unlikely to be as successful in providing accurate information to decision makers. 

SUMMARY OF THE INVENTION (DISCLOSURE OF THE INVENTION) 
The present invention is of an apparatus and method for displaying viewer reactions to a 
display object comprising: dividing the display object into a plurality of spatial regions; collecting 
viewer reactions to an exposure to the display object; correlating the viewer reactions with the 
spatial regions; and displaying the display object with an aspect of the display of each spatial 
region being a function of the viewer reactions for the region. In the preferred embodiment, the 
display object is divided into a matrix, with each spatial region being a cell of the matrix. 
Collecting is preferably by exposing a viewer, or a plurality of viewers, to the display object for a 
duration between % and 4 second, and most preferably a plurality of exposures to the display 
object are employed. The display object is displayed with the transparency (and/or color 
tingeing) of each spatial region being a function of the viewer reactions for the region. A static 
image (or images) may be displayed, or a motion picture sequence employed, preferably of a 
plurality of images corresponding to a plurality of viewer exposures to the display image. 

A primary object of the present invention is to provide a straightforward means for 
displaying information collected about a display object's impact on viewers. 

A primary advantage of the present invention is that it is intuitively understandable by 
decision makers at all levels. 
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Other objects, advantages and novel features, and further scope of applicability of the 
present invention will be set forth in part in the detailed description to follow, taken in 
conjunction with the accompanying drawings, and in part will become apparent to those skilled 
5 in the art upon examination of the following, or may be learned by practice of the invention. The 
objects and advantages of the invention may be realized and attained by means of the 
instrumentalities and combinations particularly pointed out in the appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 
10 The accompanying drawings, which are incorporated into and form a part of the 

specification, illustrate several embodiments of the present invention and, together with the 
description, serve to explain the principles of the invention. The drawings are only for the 
purpose of illustrating a preferred embodiment of the invention and are not to be construed as 
limiting the invention. In the drawings: 

15 

Fig. 1 illustrates a display object to be displayed according to the invention; 

Figs. 2-4 illustrate the display of the invention of viewer information collected about the 
display object of Fig. 1 at >2, 1, and 4 second exposures, respectively; and 

20 

Fig. 5 is a schematic diagram of the preferred apparatus of the invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
(BEST MODES FOR CARRYING OUT THE INVENTION) 
25 The purpose of the present invention is to provide an intuitively appealing method for 

displaying diagnostic research data or information collected about how an audience or sample 
of research subjects processes and responds to visually complex display objects. Such a 
method aids decision makers in quickly seeing the strengths and weaknesses of different 
elements of a display object in terms of how well they elicit desired effects. 
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An "display object", for purposes of the specification and claims, is any visual stimulus 
represented or projected on a two-dimensional surface and designed to communicate a specific 
set of messages in order to elicit an intended response from viewers of that stimulus. Display 
5 objects include print advertisements, pages from catalogs, magazines or other printed 

publications, and screens from pages published electronically, as on the Internet or CD-ROMs. 
Display objects also include photographs or artistic renderings used as virtual representations of 
three dimensional communication spaces such as store environments, exhibition spaces, or 
street scenes (e.g., one cluttered with signage). 



The present invention is designed to work with various manners of data collection that 
measure a human response to various parts of a display object. Two data collection methods 
are preferred, but others will be seen to be useful with the present invention by one skilled in the 
art. 



The first preferred data collection approach makes use of controlled time exposures via a 
computerized interview. Each respondent is exposed to the display object on a computer 
screen for a sequence of measured time periods. For example, the respondent might be 
exposed to the test for three time exposures: Vz second, 1 second, and 4 seconds. After each 

20 exposure, the respondent is asked to record what he or she saw. The respondent may also be 
asked to indicate where exactly on the page or screen he or she saw items and that data is 
recorded on a grid. The information is then coded to determine how long it takes for viewers to 
register key elements such as a headline, a character, a package, a brand name, or the like. 
Depending on the purposes of the study, different time periods and a different number of 

25 exposures may be used. This method of data collection measures the order in which 
respondents take in or process the information contained in a display object. 



10 
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The second preferred data collection approach is concerned with how people respond to 
the different parts of the display object. Response can refer to likeability or appeal, purchase 
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interest, relevance, or some other measure of emotional or cognitive response. For this 
measurement, respondents are shown a copy of the display object with a grid or matrix 
superimposed over it and are asked to provide a rating of their level of response to each cell of 
the matrix. 



The invention is of a method of displaying information gathered about a display object, 
such as that of Fig, 1, divided into a grid. First, an opaque screen in the form of an n x m matrix 
is superimposed on a copy of the display object. Next, the research measurement associated 
with a particular cell of the matrix is used to determine the degree of transparency of the part of 

10 the screen covering that cell. For example, if after a % second exposure, 30% of respondents 
indicated that they noticed a package in the part of the display object contained in cell 1 x 2, 
then the degree of transparency of the opaque screen covering cell 1 x 2 would be set to a 
value which is a function of 30%, such as the function x = x, which results in a 30% 
transparency. This adjustment is preferably performed for all cells in the matrix for each 

15 measurement taken. 

In order to display the sequence of viewer information processing, two types of display 
may be used. The first display presents all of the measurements collected simultaneously in a 
side-by-side arrangement of the different display screens associated with the timed exposures. 

20 An example of this type of display is shown in Figs. 2-4. Fig. 2 shows that the consumer's eye 
at the Vz second mark is attracted to the message in the yellow box and the dog at the top of the 
display object. Fig, 3 shows that the attention at the 1 -second mark moves down to the store's 
logo. Fig. 4 shows that at the 4-second mark the consumer begins examining the prices of 
products featured on the sides of the display object. A second display type is in the form of a 

25 movie that shows the progression of viewer attention in a more dynamic way, with a dramatic 
effect much like that of a photograph developing in the darkroom of viewer consciousness. 
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In order to display information about viewer response, a similar approach is used insofar 
as a semi-transparent screen divided into measurement cells is superimposed on the display 
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object. In order to remind decision-makers that a different measurement is being referred to in 
the display, color may be used with the degree of color saturation indexed to the underlying 
measurement. 

5 Fig. 5 illustrates the preferred embodiment of the apparatus of the inventionlO. Personal 

computer 12, or like image processor, is used to receive and/or calculate the correlations 
between collected information from viewers and spatial regions of a display object designated 
by the user. The personal computer or image processor then places into video memory (or like 
storage) an appropriate image of the display object with spatial regions assigned different 

10 transparencies and/or color tingeing. Images according to the invention may then be displayed 
in any manner known to the art. such as on a display 18 or on surface 16 via projector 14 (such 
as a liquid-crystal device (LCD) projector). 

Although the invention has been described in detail with particular reference to these 
15 preferred embodiments, other embodiments can achieve the same results. Variations and 

modifications of the present invention will be obvious to those skilled in the art and it is intended 
to cover in the appended claims all such modifications and equivalents. The entire disclosures 
of all references, applications, patents, and publications cited above are hereby incorporated by 
reference. 



